Touch display device with light sensor module

ABSTRACT

A touch display device and a light sensor module are discussed. The touch display device includes i light sensor modules, where i is a natural number greater than 1, for sensing a touch applied to a touch display panel, and a malfunction recovery unit for determining whether each of the i light sensor modules malfunctions and restarting at least one of the i light sensor modules when the at least one light sensor module is determined to malfunction.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a Divisional of co-pending U.S. application Ser. No.14/067,773 filed on Oct. 30, 2013, which claims the benefit of KoreanPatent Application No. 10-2012-0122332 filed on Oct. 31, 2012, all theseapplications are hereby incorporated by reference as if fully set forthherein.

BACKGROUND OF THE INVENTION

1. Field of the Invention

The present invention relates to a touch display device, and moreparticularly, to a touch display device which is capable of, when staticelectricity is generated, accurately determining whether light sensormodules malfunction and recovering malfunctioning ones of the lightsensor modules, so as to accurately generate touch coordinates.

2. Discussion of the Related Art

In general, a touch display device is one of a variety of schemes forproviding an interface between an information communication deviceemploying various display technologies and the user, and is an inputdevice which enables the user to interface with the informationcommunication device by directly touching a screen by hand or using apen.

However, the touch display device has a disadvantage of highvulnerability to static electricity because of the aforementionedtouch-based interface scheme.

In particular, in the case where the touch display device employs aninfrared sensor module system which determines presence/absence of atouch and touch coordinates using infrared light, introduction of staticelectricity to an infrared sensor module may cause malfunction of theinfrared sensor module, resulting in difficulty in accuratelycalculating the touch coordinates. For example, even if a touch does notactually occur, touch occurrence may be misrecognized, or touchcoordinates of a point different from a point actually touched by theuser may be misrecognized as touch coordinates of the actually touchedpoint.

SUMMARY OF THE INVENTION

Accordingly, the present invention is directed to a touch display deviceand a light sensor module recovery method thereof that substantiallyobviate one or more problems due to limitations and disadvantages of therelated art.

An object of the present invention is to provide a touch display devicewhich is capable of finding out and restarting a malfunctioning lightsensor module to normally operate it, so as to accurately determinepresence/absence of a touch and accurately generate touch coordinates,and a light sensor module recovery method thereof.

Additional advantages, objects, and features of the invention will beset forth in part in the description which follows and in part willbecome apparent to those having ordinary skill in the art uponexamination of the following or may be learned from practice of theinvention. The objectives and other advantages of the invention may berealized and attained by the structure particularly pointed out in thewritten description and claims hereof as well as the appended drawings.

To achieve these objects and other advantages and in accordance with thepurpose of the invention, as embodied and broadly described herein, atouch display device includes i light sensor modules (where i is anatural number greater than 1) for sensing a touch applied to a touchdisplay panel, and a malfunction recovery unit for determining whethereach of the i light sensor modules malfunctions and restarting at leastone of the i light sensor modules when the at least one light sensormodule is determined to malfunction.

The malfunction recovery unit may determine whether each of the i lightsensor modules malfunctions, based on whether static electricity isintroduced to a corresponding one of the i light sensor modules.

The malfunction recovery unit may include a data generation unit forgenerating reference data based on light sense data of mth to nth framesprovided from each of the i light sensor modules and generatingcomparison data based on light sense data of a kth frame (where k is anatural number greater than n) provided from each of the i light sensormodules, a malfunction determination unit for comparing the comparisondata from the data generation unit with the reference data therefrom anddetermining whether the i light sensor modules malfunction, based on aresult of the comparison, and a restart control unit for determiningwhether to restart the at least one of the i light sensor modules, basedon a result of the determination of the malfunction determination unit.

The data generation unit may include an accumulated data generator foraccumulating the light sense data of the mth to nth frames provided fromany one of the i light sensor modules to generate accumulated data ofthe one light sensor module, and generating accumulated data of theother light sensor modules in the same manner to generate a total of iaccumulated data, a reference data generator for dividing theaccumulated data of the one light sensor module by the number of pixelsformed in the one light sensor module to generate reference unit averagedata of the one light sensor module, generating reference unit averagedata of the other light sensor modules in the same manner to generate atotal of i reference unit average data, and dividing a sum of the ireference unit average data by i to generate reference total averagedata, and a comparison data generator for summing up the light sensedata of the kth frame provided from the one light sensor module togenerate sum data, dividing the sum data by the number of the pixelsformed in the one light sensor module to generate comparison unitaverage data of the one light sensor module, generating comparison unitaverage data of the other light sensor modules in the same manner togenerate a total of i comparison unit average data, and dividing a sumof the i comparison unit average data by i to generate comparison totalaverage data, wherein the i reference unit average data and thereference total average data may be included in the reference data, andwherein the i comparison unit average data and the comparison totalaverage data may be included in the comparison data.

The malfunction determination unit may include a comparator forcomparing each of the i comparison unit average data from the datageneration unit with a corresponding one of the i reference unit averagedata from the data generation unit and comparing the comparison totalaverage data with the reference total average data, a counter forincreasing a check frame value or resetting the check frame value to aninitial value, based on comparison results from the comparator, and adeterminer for comparing the check frame value from the counter with apredetermined threshold value and determining that the at least one ofthe i light sensor modules malfunctions or the i light sensor modulesare normal, based on a result of the comparison, wherein the referencedata generator may generate reference data based on light sense data ofpth to qth frames (where p is a natural number greater than n and q is anatural number greater than p) provided from each of the i light sensormodules when the determiner determines that the at least one lightsensor module malfunctions, and wherein the comparison data generatormay generate i comparison unit average data and comparison total averagedata based on light sense data of a (k+1)th frame provided from each ofthe i light sensor modules when the determiner determines that the ilight sensor modules are normal.

The determiner may determine that the at least one of the i light sensormodules malfunctions, when the check frame value is equal to thethreshold value, and determine that the i light sensor modules arenormal, when the check frame value is less than the threshold value.

The determiner may reset the check frame value to the initial value whenthe check frame value is equal to the threshold value.

The counter may increment the check frame value by one when thecomparison results from the comparator satisfy a condition that each ofthe i comparison unit average data is greater or less by 10% than thecorresponding one of the i reference unit average data and thecomparison total average data is greater or less by 10% than thereference total average data, and reset the check frame value to theinitial value when the comparison results from the comparator do notsatisfy the condition.

The restart control unit may restart the at least one of the i lightsensor modules when the determiner determines that the at least onelight sensor module malfunctions.

Alternatively, the restart control unit may restart all of the i lightsensor modules when the determiner determines that the at least one ofthe i light sensor modules malfunctions.

The mth to nth frames may be generated immediately after power isapplied to the touch display device or immediately after the at leastone of the i light sensor modules is restarted.

The malfunction recovery unit may further include i switches each forselecting any one of a restart signal and a sensor driving voltage basedon the determination of the restart control unit and transmitting theselected one to a corresponding one of the i light sensor modules.

The restart signal may include an initialization voltage and the sensordriving voltage, which are sequentially generated, wherein theinitialization voltage may be generated ahead of the sensor drivingvoltage.

The touch display device may further include a touch controller forcalculating coordinates of the touch based on the light sense dataprovided from the i light sensor modules, wherein the light sense dataprovided from the i light sensor modules may be stored in a memory ofthe touch controller, wherein the light sense data stored in the memorymay be read by the data generation unit and the touch controller.

The touch controller may temporarily stop a touch presence/absencedetermination operation and a touch coordinates calculation operationfor a predetermined period of time when the at least one light sensormodule is restarted.

The predetermined period of time may be 2 seconds or less.

The touch display device may further include a touch controller forcalculating coordinates of the touch based on the light sense dataprovided from the i light sensor modules and performing anauto-calibration operation for the i light sensor modules, wherein theauto-calibration operation of the touch controller may be performedahead of a data generation operation of the data generation unit or in aperiod between a reference data generation operation and a comparisondata generation operation of the data generation unit.

Each of the i light sensor modules may be an infrared sensor modulewhich senses the touch using an infrared ray.

The malfunction determination unit may include first to ith comparatorseach for comparing a corresponding one of the i comparison unit averagedata from the data generation unit with a corresponding one of the ireference unit average data from the data generation unit and comparingthe comparison total average data with the reference total average data,first to ith counters each for increasing a corresponding check framevalue or resetting the corresponding check frame value to an initialvalue, based on comparison results from a corresponding one of the firstto ith comparators, and first to ith determiners each for comparing thecheck frame value from a corresponding one of the first to ith counterswith a predetermined threshold value and determining whether acorresponding one of the i light sensor modules malfunctions, based on aresult of the comparison, wherein the reference data generator maygenerate reference data based on light sense data of pth to qth frames(where p is a natural number greater than n and q is a natural numbergreater than p) provided from each of the i light sensor modules whenany one of the determiners determines that the corresponding lightsensor module malfunctions, and wherein the comparison data generatormay generate i comparison unit average data and comparison total averagedata based on light sense data of a (k+1)th frame provided from each ofthe i light sensor modules when the determiners determine that the ilight sensor modules are normal.

An rth one of the counters (where r is any one of 1 to i) may incrementthe corresponding check frame value by one when the comparison resultsfrom an rth one of the comparators satisfy a condition that thecomparison unit average data of an rth one of the light sensor modulesis greater or less by 10% than the reference unit average data of therth light sensor module and the comparison total average data is greateror less by 10% than the reference total average data, and reset thecorresponding check frame value to the initial value when the comparisonresults from the rth comparator do not satisfy the condition.

The restart control unit may include first to ith restart controllerseach for determining whether to restart the corresponding light sensormodule, based on a determination result from a corresponding one of thefirst to ith determiners.

An rth one of the restart controllers (where r is any one of 1 to i) mayrestart the rth light sensor module when an rth one of the determinersdetermines that the rth light sensor module malfunctions.

The touch display device may further include a touch controller forcalculating coordinates of the touch based on the light sense dataprovided from the i light sensor modules, wherein the touch controller,when any one of the i light sensor modules is restarted and theremaining two or more light sensor modules are normally driven, maycalculate the touch coordinates using the light sense data from theremaining two or more light sensor modules.

The touch display device may further include a touch controller forcalculating coordinates of the touch based on the light sense dataprovided from the i light sensor modules, wherein the touch controllermay temporarily stop a touch coordinates calculation operation for apredetermined period of time when at least two of the i light sensormodules are restarted.

It is to be understood that both the foregoing general description andthe following detailed description of the present invention areexemplary and explanatory and are intended to provide furtherexplanation of the invention as claimed.

BRIEF DESCRIPTION OF THE DRAWINGS

The accompanying drawings, which are included to provide a furtherunderstanding of the invention and are incorporated in and constitute apart of this application, illustrate embodiment(s) of the invention andtogether with the description serve to explain the principle of theinvention. In the drawings:

FIG. 1 is a schematic view of a touch display device according to anembodiment of the present invention;

FIG. 2 is a waveform diagram of a reference signal set in any one lightsensor module in FIG. 1 and a light sense signal generated therefrom;

FIG. 3 is a detailed block diagram of a malfunction recovery unit inFIG. 1;

FIG. 4 is a detailed block diagram of a data generation unit in FIG. 3;

FIG. 5 is a table illustrating a method of calculating accumulated dataof any one light sensor module in FIG. 1;

FIG. 6 is a detailed block diagram of a malfunction determination unitin FIG. 3;

FIG. 7 is a detailed block diagram showing another configuration of themalfunction recovery unit in FIG. 1 including switches;

FIG. 8 is a detailed block diagram of any one of the switches in FIG. 7;

FIG. 9 is a detailed block diagram illustrating the operation of theswitch of FIG. 8;

FIG. 10 is a block diagram illustrating a connection relationship amonglight sensor modules, a memory and a touch controller;

FIG. 11 is a detailed block diagram showing another configuration of themalfunction determination unit in FIG. 3;

FIG. 12 is a detailed block diagram showing a configuration of a restartcontrol unit which is controlled based on determination results fromfirst to third determiners in FIG. 11;

FIG. 13 is a detailed block diagram showing a configuration in whichfirst to third switches are included in the configuration of FIG. 12;

FIG. 14 is a flowchart illustrating a light sensor module recoverymethod of a touch display device according to a first embodiment of thepresent invention;

FIGS. 15A and 15B are flowcharts illustrating a light sensor modulerecovery method of a touch display device according to a secondembodiment of the present invention;

FIG. 16 is a flowchart illustrating a light sensor module recoverymethod of a touch display device according to a third embodiment of thepresent invention;

FIG. 17 is a view illustrating equations of accumulated data, referenceunit average data and reference total average data in the presentinvention;

FIG. 18 is a view illustrating, in the form of equations, a step ofdetermining whether light sensor modules malfunction;

FIG. 19 is a waveform diagram of reference signals which are generatedbased on light sense data of an initial frame generated from each offirst to third light sensor modules; and

FIG. 20 is a waveform diagram illustrating variations in referencesignals resulting from the influence of static electricity.

DETAILED DESCRIPTION OF THE INVENTION

Reference will now be made in detail to the preferred embodiments of thepresent invention, examples of which are illustrated in the accompanyingdrawings. Wherever possible, the same reference numbers will be usedthroughout the drawings to refer to the same or like parts.

FIG. 1 is a schematic view of a touch display device according to anembodiment of the present invention.

The touch display device according to the present embodiment includes,as shown in FIG. 1, i light sensor modules IrSM_1 to IrSM_3 (where i isa natural number greater than 1) for sensing a touch applied to a touchdisplay panel TDP, and a malfunction recovery unit M-RC for determiningwhether each of the light sensor modules IrSM_1 to IrSM_3 malfunctionsand restarting at least one of the light sensor modules IrSM_1 to IrSM_3when the at least one light sensor module is determined to malfunction.

The light sensor modules IrSM_1 to IrSM_3 are installed at corners ofthe touch display panel TDP, as shown in FIG. 1. These installationpositions will hereinafter be described in detail with reference to theconfiguration of the touch display panel TDP.

That is, the touch display panel TDP includes a touch display unit DSPand a plurality of retroreflective plates SR1 to SR3, as shown inFIG. 1. The touch display unit DSP is formed at the center of the touchdisplay panel TDP to display an image. This touch display unit DSPreceives a touch from the user and displays an image corresponding tothe touch. Each of the touch display panel TDP and touch display unitDSP has a rectangular shape.

The first to third light sensor modules IrSM_1 to IrSM_3 are disposed inthe vicinity of outer corners of the touch display panel TDP,respectively. In detail, the first light sensor module IrSM_1 isdisposed in the vicinity of a first corner of the touch display panelTDP such that it is positioned between the first retroreflective plateSR1 and the second retroreflective plate SR2, and the second lightsensor module IrSM_2 is disposed in the vicinity of a second corner ofthe touch display panel TDP such that it is positioned between the firstretroreflective plate SR1 and the third retroreflective plate SR3. Thethird light sensor module IrSM_3 is disposed in the vicinity of a thirdcorner of the touch display panel TDP such that it is positioned betweenthe second retroreflective plate SR2 and the third retroreflective plateSR3.

Each of the light sensor modules IrSM_1 to IrSM_3 may be an infraredsensor module which senses a touch using an infrared ray.

Such a light sensor module using an infrared ray (namely, an infraredsensor module) includes an infrared light emitting diode for emittinginfrared light, an objective lens for condensing light received by theinfrared sensor module, and a photosensor for sensing the lightcondensed by the objective lens, and an optical filter disposed in frontor rear of the objective lens. Infrared light received by the lightsensor module is incident on the photosensor through the optical filterand the objective lens. The photosensor may be composed of a line sensorarray including a plurality of light receiving elements. Thisphotosensor may have a resolution of 500 pixels or more in a horizontaldirection. That is, the photosensor may have 500 pixels or more.

The infrared light emitting diode in the aforementioned light sensormodule emits infrared light towards the touch display unit DSP. At thistime, the infrared light emitted from the infrared light emitting diodeis dispersed within a certain angle. This infrared light is incident onretroreflective plates across the touch display unit DSP and is againreflected therefrom.

The touch display device according to the present invention may employonly one or two light sensor modules. However, the touch display devicepreferably includes three or more light sensor modules in order tosuppress generation of a dead zone and prevent a ghost phenomenon fromoccurring in the event of a multi-touch. That is, the use of three lightsensor modules may have the following effects. When accuratedetermination as to the number and positions of touches is difficult dueto occurrence of the touches on a line interconnecting two adjacent onesof the three light sensor modules, the remaining one light sensor modulemay determine the number and positions of the touches at a differentangle, thereby preventing generation of a dead zone. For example, when atouch occurs within an angle at which it cannot be sensed by the firstlight sensor module IrSM_1 and the second light sensor module IrSM_2,the third light sensor module IrSM_3 may sense the touch within the sameangle.

On the other hand, although not shown, four or more light sensor modulesmay be employed in the present invention.

The first to third retroreflective plates SR1 to SR3 act to reflectlights (infrared lights) emitted from the respective light sensormodules IrSM_1 to IrSM_3. The first retroreflective plate SR1 isdisposed at a first side of the touch display panel TDP, and the secondretroreflective plate SR2 is disposed at a second side of the touchdisplay panel TDP. The third retroreflective plate SR3 has an L-likeshape. That is, the third retroreflective plate SR3 has one sidedisposed at a third side of the touch display panel TDP and the otherside disposed at a fourth side of the touch display panel TDP. Each ofthe retroreflective plates SR1 to SR3 includes a plurality ofretroreflective layers laminated in a row. Each of the retroreflectivelayers is composed of a prism.

A structure including the above-stated first to third light sensormodules IrSM_1 to IrSM_3 and first to third retroreflective plates SR1to SR3 constitutes one touch assembly.

On the other hand, the first light sensor module IrSM_1 receivesinfrared lights retroreflected from the one side and the other side ofthe third retroreflective plate SR3. Each of the second and third lightsensor modules IrSM_2 and IrSM_3 receives infrared lights retroreflectedfrom at least two of the retroreflective plates SR1 to SR3 and sensesinfrared light from the other light sensor module which is diagonallyopposite thereto.

Here, infrared lights supplied to each of the light sensor modulesIrSM_1 to IrSM_3 when no touch is applied to the touch display unit DSPhave different intensities from those of infrared lights supplied toeach of the light sensor modules IrSM_1 to IrSM_3 under the conditionthat infrared lights emitted from the light sensor modules IrSM_1 toIrSM_3 are partially intercepted by touch means, such as a finger, whichtouches a certain point of the touch display unit DSP. In this regard,based on sensed infrared lights from the respective light sensor modulesIrSM_1 to IrSM_3, a touch controller (not shown) determinespresence/absence of a touch, and determines the position (coordinates)of a touch TC when the touch TC is present.

On the other hand, the malfunction recovery unit M-RC determines whethereach of the light sensor modules IrSM_1 to IrSM_3 malfunctions, based onsensed infrared lights from a corresponding one of the light sensormodules IrSM_1 to IrSM_3. That is, provided that an abnormal signal suchas static electricity is introduced to the light sensor modules IrSM_1to IrSM_3, these light sensor modules IrSM_1 to IrSM_3 will malfunction.In this regard, the malfunction recovery unit M-RC of the presentinvention determines whether static electricity is introduced to thelight sensor modules IrSM_1 to IrSM_3, to find out a malfunctioning oneof the light sensor modules IrSM_1 to IrSM_3, and restarts themalfunctioning light sensor module or all the light sensor modulesincluding the malfunctioning light sensor module to normally operate themalfunctioning light sensor module. Here, “light sensor modulerestarting” means electrically resetting the light sensor modules IrSM_1to IrSM_3, which may, for example, correspond to powering off the lightsensor modules IrSM_1 to IrSM_3 and then powering on them again afterthe lapse of a certain period of time.

On the other hand, the “abnormal signal” may be not only theaforementioned static electricity, but also any electrical signalcapable of obstructing the normal operations of the light sensor modulesIrSM_1 to IrSM_3. In this regard, the malfunction recovery unit M-RC ofthe present invention has a function of finding out and recovering, notonly errors in the light sensor modules IrSM_1 to IrSM_3 resulting fromthe static electricity, but also errors in the light sensor modulesIrSM_1 to IrSM_3 resulting from other negative signals.

Hereinafter, a representative faulty operation of the light sensormodules IrSM_1 to IrSM_3 resulting from the static electricity, which isone of the aforementioned abnormal signals, will be described withreference to FIG. 2.

FIG. 2 is a waveform diagram of a reference signal set in any one of thelight sensor modules IrSM_1 to IrSM_3 in FIG. 1 and a light sense signalgenerated therefrom, in which a dotted line represents the referencesignal and a solid line represents the light sense signal.

The X-axis of FIG. 2 represents pixels of a photosensor provided in thelight sensor module, which may be, for example, 500 in number. Here,numerals shown in FIG. 2 represent numbers of the pixels. That is, the500 pixels are numbered 1 to 500, and, for example, the numeral 50 shownin the X-axis of FIG. 2 represents a number 50 pixel.

The Y-axis of FIG. 2 represents signal strengths of lights received bythe respective pixels of the photosensor. For example, the signalstrength of light received by the number 50 pixel in FIG. 2 is about170.

As shown in FIG. 2, when the light sense signal, denoted by SES, islower in level than the reference signal, denoted by REF, the touchdisplay device recognizes that a certain portion of the touch displayunit DSP of the touch display panel is touched. That is, defining aportion of the light sense signal SES having a signal strength lowerthan that of the reference signal REF as a touch recognition signal TRS,the touch display device may determine the number and positions oftouches by determining a section in which the touch recognition signalTRS is generated. In this case, the touch display device may determinethe generation section of the touch recognition signal TRS based on thepixel numbers of the X-axis.

For accurate touch coordinates calculation, it is first required togenerate the aforementioned reference signal accurately without anerror. This reference signal signifies the intensities of infraredlights received by the respective pixels of the light sensor module wheninfrared light from the light sensor module is emitted to the touchdisplay unit and then returned to the respective pixels of the lightsensor module under the condition that no touch is applied to the touchdisplay unit. That is, the intensities of lights received respectivelyby the 500 pixels are composed of 500 digitized light sense data, and acurve indicated by the dotted line of FIG. 2 is composed of a trace ofthe 500 light sense data.

On the other hand, the light sense signal is generated based onreception results of infrared light emitted to the touch display unit inan actual driving period of the touch display device. This light sensesignal is also composed of 500 digitized light sense data, and a curveindicated by the solid line of FIG. 2 is composed of a trace of the 500light sense data.

The touch presence/absence determination and the touch coordinatescalculation are performed based on a comparison between the light sensesignal and the reference signal. For this reason, it is preferable thatthe reference signal not vary in principle.

However, when an abnormal signal such as static electricity isintroduced to the light sensor module, the reference signal set in thelight sensor module may vary, thereby making it impossible to accuratelydetermine presence/absence of a touch and accurately calculate touchcoordinates.

In contrast, the malfunction recovery unit M-RC according to the presentinvention monitors the operating states of light sensor modules in realtime to find out a malfunctioning one of the light sensor modules, andrestarts the malfunctioning light sensor module to normally operate it.Therefore, according to the present invention, even if an externalabnormal signal such as static electricity is introduced to the lightsensor modules, it is possible to accurately calculate touchcoordinates.

This malfunction recovery unit M-RC of the present invention may have aconfiguration as follows.

On the other hand, for the convenience of description, the number oflight sensor modules to be described below is assumed to be three.However, this is nothing but one example proposed for the convenience ofdescription, and four or more light sensor modules may be employed asstated previously.

FIG. 3 is a detailed block diagram of the malfunction recovery unit M-RCin FIG. 1.

The malfunction recovery unit M-RC includes a data generation unit DGN,a malfunction determination unit MDS, and a restart control unit RSC, asshown in FIG. 3.

The data generation unit DGN generates reference data RF_d based onlight sense data of mth to nth frames provided from each of the threelight sensor modules IrSM_1 to IrSM_3. The data generation unit DGN alsogenerates comparison data CM_d based on light sense data of a kth frame(where k is a natural number greater than n) provided from each of thethree light sensor modules IrSM_1 to IrSM_3. For example, the datageneration unit DGN may generate the reference data RF_d using lightsense data of initial ten frames (first to tenth frames) and generatethe comparison data CM_d using light sense data of one framecorresponding to a frame (for example, an eleventh frame) subsequent tothe initial ten frames.

Here, the mth to nth frames (or pth to qth frames) correspond toconsecutive initial frames immediately after power is applied to thetouch display device or immediately after at least one light sensormodule is restarted. A period corresponding to the initial frames is sovery short that there is little probability that an external abnormalsignal such as static electricity will be applied to the light sensormodules. Therefore, in the present invention, the reference data RF_d isgenerated based on light sense data generated in such an initial frameperiod (namely, the light sense data of the mth to nth frames).Ultimately, this reference data RF_d signifies a normal reference signalwith no distortion.

On the other hand, beginning with the kth frame, there is muchprobability that an external abnormal signal such as static electricitywill be applied to the light sensor modules. For this reason, thecomparison data CM_d generated in this frame may have a data valuedistorted by the static electricity or the like.

The malfunction determination unit MDS compares the comparison data CM_dfrom the data generation unit DGN with the reference data RF_d therefromand determines whether the three light sensor modules IrSM_1 to IrSM_3malfunction, based on a result of the comparison. That is, themalfunction determination unit MDS compares the comparison data CM_dwith the reference data RF_d, recognizes how much the comparison dataCM_d varied from the reference data RF_d, through the comparison result,and determines whether the light sensor modules IrSM_1 to IrSM_3malfunction, based on a result of the recognition.

The restart control unit RSC determines whether to restart at least oneof the light sensor modules IrSM_1 to IrSM_3, based on a result of thedetermination of the malfunction determination unit MDS. For example,when at least one of the light sensor modules IrSM_1 to IrSM_3 isdetermined to malfunction, the restart control unit RSC may restart onlythe malfunctioning light sensor module or all the light sensor modulesincluding the malfunctioning light sensor module.

On the other hand, although the light sense data generated from thethree light sensor modules IrSM_1 to IrSM_3 may be supplied directly tothe data generation unit DGN, they may be supplied to the datageneration unit DGN through a memory ME as shown in FIG. 3. That is, thelight sense data of every frame generated from the three light sensormodules IrSM_1 to IrSM_3 may be first stored in the memory ME and thenread by the data generation unit DGN. Thereafter, the data generationunit DGN may generate the above-stated reference data RF_d andcomparison data CM_d using the read light sense data.

As will be described later, the touch display device of the presentinvention may further include a touch controller for calculating touchcoordinates based on the light sense data provided from all the lightsensor modules IrSM_1 to IrSM_3. An internal memory built in the touchcontroller may be used instead of the above memory ME.

This data generation unit DGN may have a configuration as willhereinafter be described in detail with reference to FIG. 4.

FIG. 4 is a detailed block diagram of the data generation unit DGN inFIG. 3.

The data generation unit DGN includes an accumulated data generator ADG,a reference data generator RDG, and a comparison data generator CDG, asshown in FIG. 4.

The accumulated data generator ADG accumulates the light sense data,denoted by LS_mn_d1, of the mth to nth frames provided from the firstlight sensor module IrSM_1 to generate accumulated data AC_d1 of thefirst light sensor module IrSM_1. The accumulated data generator ADGalso accumulates the light sense data, denoted by LS_mn_d2, of the mthto nth frames provided from the second light sensor module IrSM_2 togenerate accumulated data AC_d2 of the second light sensor moduleIrSM_2. In a similar manner, the accumulated data generator ADGaccumulates the light sense data, denoted by LS_mn_d3, of the mth to nthframes provided from the third light sensor module IrSM_3 to generateaccumulated data AC_d3 of the third light sensor module IrSM_3. In thismanner, the accumulated data generator ADG generates the total threeaccumulated data AC_d1 to AC_d3. Hereinafter, a detailed example ofgenerating any one accumulated data will be described with reference toFIG. 5.

FIG. 5 is a table illustrating a method of calculating accumulated dataof any one light sensor module in FIG. 1.

The first horizontal line of FIG. 5 represents frame numbers whichindicate a total of ten frames {circle around (1)} to {circle around(10)} numbered 1 to 10.

The second horizontal line of FIG. 5 represents a sum of light sensedata belonging to each frame. For example, provided that the one lightsensor module includes 500 pixels, the total number of light sense dataof one frame generated from the light sensor module will be 500. Thatis, 500 light sense data are generated in every frame from the one lightsensor module, and a numeral indicated in each cell of the secondhorizontal line signifies a sum of a total of 500 light sense datagenerated in a corresponding frame. For example, as shown in FIG. 5, thesum of 500 light sense data corresponding to the number 2 frame {circlearound (2)} is “500”, and the sum of 500 light sense data correspondingto the number 3 frame {circle around (3)} is “700”.

The third horizontal line of FIG. 5 represents a sum of a sum of lightsense data of a current frame (namely, a corresponding frame) andaccumulated data of a previous frame. For example, accumulated data 2450of the number 5 frame (current frame) {circle around (5)} is a sum(namely, 600+1850) of a sum 600 of light sense data of the number 5frame {circle around (5)} and accumulated data 1850 of the number 4frame (previous frame) {circle around (4)}.

Therefore, in the case where the light sense data of the ten frames{circle around (1)} to {circle around (10)} have values as shown in FIG.5, the final accumulated data (accumulated data of the ten frames) has avalue of “5250”. That is, this value “5250” is the very accumulated dataof this one light sensor module.

In this manner, the accumulated data (final accumulated data) of each ofall the light sensor modules IrSM_1 to IrSM_3 is generated by theaccumulated data generator ADG of the data generation unit DGN.

On the other hand, the light sense data and accumulated data of theinitial number 1 frame {circle around (1)} generally have an initialvalue of 0, as shown in FIG. 5. For this reason, in order to minimizesuch deviation, the above accumulated data may be generated using dataof frames other than the number 1 frame.

Referring again to FIG. 4, the reference data generator RDG divides theaccumulated data AC_d1 of the first light sensor module IrSM_1 by thenumber (for example, 500) of pixels formed in the first light sensormodule IrSM_1 to generate reference unit average data R_AV_d1 of thefirst light sensor module IrSM_1. The reference data generator RDG alsodivides the accumulated data AC_d2 of the second light sensor moduleIrSM_2 by the number of pixels formed in the second light sensor moduleIrSM_2 to generate reference unit average data R_AV_d2 of the secondlight sensor module IrSM_2. In a similar manner, the reference datagenerator RDG divides the accumulated data AC_d3 of the third lightsensor module IrSM_3 by the number of pixels formed in the third lightsensor module IrSM_3 to generate reference unit average data R_AV_d3 ofthe third light sensor module IrSM_3. In addition, the reference datagenerator RDG divides a sum of the three reference unit average dataR_AV_d1 to R_AV_d3 by 3 (the number of the light sensor modules) togenerate reference total average data R_TT_d.

In this manner, the reference data generator RDG generates the totalthree reference unit average data R_AV_d1 to R_AV_d3 and the onereference total average data R_TT_d.

As shown in FIG. 4, the comparison data generator CDG sums up the lightsense data, denoted by LS_k_d1, of the kth frame (for example, theeleventh frame) provided from the first light sensor module IrSM_1 togenerate sum data (a sum of 500 light sense data), and divides the sumdata by the number (for example, 500) of pixels formed in the firstlight sensor module IrSM_1 to generate comparison unit average dataC_AV_d1 of the first light sensor module IrSM_1. The comparison datagenerator CDG also sums up the light sense data, denoted by LS_k_d2, ofthe kth frame (for example, the eleventh frame) provided from the secondlight sensor module IrSM_2 to generate sum data, and divides the sumdata by the number (for example, 500) of pixels formed in the secondlight sensor module IrSM_2 to generate comparison unit average dataC_AV_d2 of the second light sensor module IrSM_2. In a similar manner,the comparison data generator CDG sums up the light sense data, denotedby LS_k_d3, of the kth frame (for example, the eleventh frame) providedfrom the third light sensor module IrSM_3 to generate sum data, anddivides the sum data by the number (for example, 500) of pixels formedin the third light sensor module IrSM_3 to generate comparison unitaverage data C_AV_d3 of the third light sensor module IrSM_3. Inaddition, the comparison data generator CDG divides a sum of the threecomparison unit average data C_AV_d1 to C_AV_d3 by 3 (the number of thelight sensor modules) to generate comparison total average data C_TT_d.

In this manner, the comparison data generator CDG generates the totalthree comparison unit average data C_AV_d1 to C_AV_d3 and the onecomparison total average data C_TT_d.

Here, the three reference unit average data R_AV_d1 to R_AV_d3 and theone reference total average data R_TT_d are included in the above-statedreference data RF_d. In other words, one set of three reference unitaverage data R_AV_d1 to R_AV_d3 and one reference total average dataR_TT_d is considered to be one reference data RF_d.

In a similar manner, the three comparison unit average data C_AV_d1 toC_AV_d3 and the one comparison total average data C_TT_d are included inthe above-stated comparison data CM_d. In other words, one set of threecomparison unit average data C_AV_d1 to C_AV_d3 and one comparison totalaverage data C_TT_d is considered to be one comparison data CM_d.

FIG. 6 is a detailed block diagram of the malfunction determination unitMDS in FIG. 3.

The malfunction determination unit MDS includes a comparator CMP, acounter COT, and a determiner DSC, as shown in FIG. 6.

The comparator CMP compares each of the three comparison unit averagedata C_AV_d1 to CAV_d3 from the data generation unit DGN with acorresponding one of the three reference unit average data R_AV_d1 toR_AV_d3 from the data generation unit DGN. For example, the comparisonunit average data C_AV_d1 of the first light sensor module IrSM_1(referred to hereinafter as first comparison unit average data) iscompared with the reference unit average data R_AV_d1 of the first lightsensor module IrSM_1 (referred to hereinafter as first reference unitaverage data), and the comparison unit average data C_AV_d2 of thesecond light sensor module IrSM_2 (referred to hereinafter as secondcomparison unit average data) is compared with the reference unitaverage data R_AV_d2 of the second light sensor module IrSM_2 (referredto hereinafter as second reference unit average data). The comparisonunit average data C_AV_d3 of the third light sensor module IrSM_3(referred to hereinafter as third comparison unit average data) iscompared with the reference unit average data R_AV_d3 of the third lightsensor module IrSM_3 (referred to hereinafter as third reference unitaverage data). In addition, the comparator CMP compares the comparisontotal average data C_TT_d with the reference total average data R_TT_d.

The counter COT adjusts a check frame value based on the comparisonresults from the comparator CMP. For example, based on the comparisonresults, the counter COT increments the check frame value by one orresets the check frame value to an initial value (for example, 0).

The operations of the comparator CMP and counter COT will hereinafter bedescribed in detail with reference to the following example.

That is, as one example, when the comparison results from the comparatorCMP satisfy a condition that each of the comparison unit average dataC_AV_d1 to C_AV_d3 is greater or less by 10% than the corresponding oneof the reference unit average data R_AV_d1 to R_AV_d3 and the comparisontotal average data C_TT_d is greater or less by 10% than the referencetotal average data R_TT_d, the counter COT increments the check framevalue by one. In detail, when the comparison results from the comparatorCMP satisfy a condition that the first comparison unit average dataC_AV_d1 is greater or less by 10% than the first reference unit averagedata R_AV_d1, the second comparison unit average data C_AV_d2 is greateror less by 10% than the second reference unit average data R_AV_d2, thethird comparison unit average data C_AV_d3 is greater or less by 10%than the third reference unit average data R_AV_d3 and the comparisontotal average data C_TT_d is greater or less by 10% than the referencetotal average data R_TT_d, the counter COT increments the check framevalue in the corresponding frame by one. Conversely, when this conditionis not satisfied, the counter COT resets the check frame value to theinitial value 0.

The determiner DSC compares the check frame value from the counter COTwith a predetermined threshold value and determines whether at least oneof the three light sensor modules malfunctions, based on a result of thecomparison. That is, based on the comparison result, the determiner DSCdetermines that any one of the three light sensor modules malfunctionsor all of the three light sensor modules are normal.

For example, when the check frame value is equal to the threshold value,the determiner DSC finally determines that at least one of the threelight sensor modules malfunctions. That is, at the moment that the checkframe value reaches the threshold value while being incremented by onein every frame, the determiner DSC determines that any one light sensormodule malfunctions. In other words, when the above condition issuccessively satisfied in frames of a number corresponding to thethreshold value, the determiner DSC finally determines that the at leastone light sensor module malfunctions.

In contrast, when the check frame value is less than the thresholdvalue, the determiner DSC determines that the three light sensor modulesare normal. Here, the threshold value may be, for example, 50. Inconclusion, in the case where the check frame value is successivelyincreased in several frames (for example, 50 frames) (namely, in thecase where malfunction is successively detected in the several frames),the determiner DSC finally determines that any one light sensor modulemalfunctions. The reason is that an abnormal signal discontinuouslygenerated in less than 50 frames may be considered to be ignorablenoise, not an abnormal signal such as static electricity.

When the determiner DSC finally determines the at least one light sensormodule to malfunction, in this manner, the above-stated restart controlunit RSC of FIG. 3 restarts the at least one light sensor module.

On the other hand, when the at least one light sensor module is finallydetermined to malfunction by the determiner DSC and then restarted bythe restart control unit RSC, the reference data generator RDG generatesreference data RF_d based on light sense data of pth to qth frames(where p is a natural number greater than n and q is a natural numbergreater than p) provided from each of the three light sensor modulesIrSM_1 to IrSM_3. Namely, when at least one of the light sensor modulesIrSM_1 to IrSM_3 malfunctions, it is restarted. In this case, it isrequired to generate new reference data RF_d based on other light sensedata (light sense data corresponding to initial frames) generated fromall the light sensor modules including the restarted light sensormodule. For this reason, after the above restarting, the reference datagenerator RDG generates new reference data RF_d based on the light sensedata of the pth to qth frames (for example, other initial ten frames).At this time, because the check frame value has also already reached thethreshold value, it is reset to the initial value 0.

On the other hand, when the determiner DSC determines that the threelight sensor modules IrSM_1 to IrSM_3 are normal, the comparison datagenerator CDG generates three comparison unit average data and onecomparison total average data based on light sense data of a (k+1)thframe (for example, a twelfth frame) provided from each of the first tothird light sensor modules IrSM_1 to IrSM_3. Namely, in the case whereit is determined that all the light sensor modules are normal in thecurrent frame (the eleventh frame), based on the analysis results of thelight sense data of that frame, light sense data corresponding to a nextframe are analyzed in the above manner for a determination as to whetherthe light sensor modules malfunction in the next frame. At this time,the check frame value is also reset to the initial value 0.

The mth to nth frames (or the pth to qth frames) correspond toconsecutive frames immediately after power is applied to the touchdisplay device or immediately after at least one light sensor module isrestarted. In the above example, the mth to nth frames correspond toconsecutive frames immediately after power is applied to the touchdisplay device, and the pth to qth frames correspond to consecutiveframes immediately after at least one light sensor module is restarted.

On the other hand, the malfunction recovery unit M-RC may furtherinclude three switches, as will hereinafter be described in detail withreference to FIG. 7.

FIG. 7 is a detailed block diagram showing another configuration of themalfunction recovery unit M-RC including switches.

First to third switches SW1 to SW3 are shown in FIG. 7.

The first switch SW1 selects any one of a restart signal and a sensordriving voltage based on the determination of the restart control unitRSC and transmits the selected one to the first light sensor moduleIrSM_1.

The second switch SW2 selects any one of the restart signal and thesensor driving voltage based on the determination of the restart controlunit RSC and transmits the selected one to the second light sensormodule IrSM_2.

The third switch SW3 selects any one of the restart signal and thesensor driving voltage based on the determination of the restart controlunit RSC and transmits the selected one to the third light sensor moduleIrSM_3.

Here, a signal based on the determination of the restart control unitRSC may be supplied in common to the first to third switches SW1 to SW3.For example, upon determining to restart at least one of the lightsensor modules IrSM_1 to IrSM_3, the restart control unit RSC generatesa restart determination signal and supplies the generated restartdetermination signal to each of the first to third switches SW1 to SW3.Then, the first switch SW1 switches and transmits the restart signal tothe first light sensor module IrSM_1, the second switch SW2 switches andtransmits the restart signal to the second light sensor module IrSM_2,and the third switch SW3 switches and transmits the restart signal tothe third light sensor module IrSM_3. In the case where all of the threeswitches SW1 to SW3 are supplied with the same restart determinationsignal to switch the restart signal in common in this manner, the threelight sensor modules IrSM_1 to IrSM_3 are restarted at the same time.

Here, the restart signal is composed of an initialization voltage andthe sensor driving voltage, which are sequentially generated. Theinitialization voltage is generated ahead of the sensor driving voltage.In these initialization voltage and sensor driving voltage constitutingthe restart signal, the initialization voltage is maintained only for acertain period of time, and the sensor driving voltage is generatedimmediately after the end of the maintenance period. The sensor drivingvoltage is maintained until the initialization voltage is againgenerated.

Each light sensor module is powered off by the initialization voltageand then powered on again by the sensor driving voltage.

The initialization voltage may be a ground voltage of OV, and the sensordriving voltage may be a constant voltage of 3.3V.

FIG. 8 is a detailed block diagram of any one of the switches SW1 to SW3in FIG. 7.

Any one of the switches SW1 to SW3, for example, the first switch SW1includes a ground terminal T2, a drive terminal T3, a module terminalT1, and a connection adjuster B, as shown in FIG. 8. The ground terminalT2 is grounded, the drive terminal T3 is supplied with the sensordriving voltage, denoted by VCC, and the module terminal T1 is connectedto the first light sensor module IrSM_1. The connection adjuster B hasone side fixedly connected to the module terminal T1 and the other sideconnected to the ground terminal T2 or drive terminal T3 depending onlogic of the restart determination signal. An amplifier AMP outputs afirst control voltage when the restart determination signal has adigital value of “0”, and a second control voltage when the restartdetermination signal has a digital value of “1”.

In response to the first control voltage, the other side of theconnection adjuster B is connected to the drive terminal T3. Incontrast, in response to the second control voltage, the other side ofthe connection adjuster B is first connected to the ground terminal T2and then to the drive terminal T3. That is, the other side of theconnection adjuster B is sequentially connected to the ground terminalT2 and the drive terminal T3 by the second control voltage. Thisoperation of the first switch SW1 will hereinafter be described indetail with reference to FIG. 9.

FIG. 9 is a detailed block diagram illustrating the operation of theswitch of FIG. 8.

When the second control voltage is applied to the first switch SW1, theother side of the connection adjuster B is first connected to the groundterminal T2, as shown in FIG. 9(a). Then, after the lapse of a certainperiod of time, the other side of the connection adjuster B is movedfrom the ground terminal T2 to the drive terminal T3, as shown in FIG.9(b). As a result, the other side of the connection adjuster B isconnected to the drive terminal T3. In this manner, the other side ofthe connection adjuster B is sequentially connected to the groundterminal T2 and the drive terminal T3 by the second control voltage.Therefore, the initialization voltage (ground voltage GND) and thesensor driving voltage VCC are sequentially applied to the first lightsensor module IrSM_1, so as to restart this first light sensor moduleIrSM_1.

The second and third switches SW2 and SW3 are also the same inconfiguration as the first switch SW1, with the exception that themodule terminal T1 of the second switch SW2 is connected to the secondlight sensor module IrSM_2 and the module terminal T1 of the thirdswitch SW3 is connected to the third light sensor module IrSM_3.

FIG. 10 is a block diagram illustrating a connection relationship amonglight sensor modules, a memory ME and a touch controller TCC.

As described above, the touch display device according to the presentinvention may further include the touch controller TCC. Based on thesensed infrared lights from the first to third light sensor modulesIrSM_1 to IrSM_3, the touch controller TCC determines presence/absenceof a touch, and calculates the coordinates of a touch when the touch ispresent.

On the other hand, although the light sense data generated from thethree light sensor modules IrSM_1 to IrSM_3 may be supplied directly tothe touch controller TCC, they may be supplied to the touch controllerTCC through the memory ME as shown in FIG. 10. That is, the light sensedata of every frame generated from the three light sensor modules IrSM_1to IrSM_3 may be first stored in the memory ME and then read by thetouch controller TCC. Thereafter, using the read light sense data, thetouch controller TCC may determine presence/absence of a touch andcalculate touch coordinates.

The memory ME may be built in the touch controller TCC. On the otherhand, the memory ME in FIG. 10 may be the same as the memory ME in FIG.3. That is, one memory ME may be built in the touch controller TCC, andused together by the touch controller TCC and the data generation unitDGN.

On the other hand, when at least one light sensor module is restarted,the touch controller TCC may temporarily stop the touch coordinatescalculation operation for a predetermined period of time. For example,in the case where the first and second light sensor modules IrSM_1 andIrSM_2 among the three light sensor modules IrSM_1 to IrSM_3 are finallydetermined to malfunction and only they are then selectively restarted,no light sense data is generated from the first and second light sensormodules IrSM_1 and IrSM_2 for this restart period. As a result, for thisrestart period, the touch controller TCC has no choice but to determinepresence/absence of a touch and touch coordinates using only the lightsense data from the remaining third light sensor module IrSM_3 whichnormally operates.

However, the presence/absence of a touch and the touch coordinatesdetermined based on only light sense data from one light sensor moduleare so very inaccurate that incorrect information may be transmitted tothe user.

Therefore, in the present invention, the touch controller TCC iscontrolled such that it does rather not perform the abovetouch-associated processing operations (the touch presence/absencedetermination operation, touch coordinates calculation operation, touchalgorithm execution operation, etc.) for the restart period, therebyfundamentally preventing incorrect information from being transmitted tothe user from the very first. To this end, the restart determinationsignal from the restart control unit RSC may also be transmitted to thetouch controller TCC. When the restart determination signal is “1” inlogic, the touch controller TCC stops the above touch-associatedprocessing operations for a predetermined no-response period.Thereafter, when the no-response period has elapsed, the touchcontroller TCC performs the above operations again. Here, theno-response period may be longer than or equal to the above restartperiod. As another example, the no-response period may be set to 2seconds or less.

On the other hand, the touch controller TCC may further perform anoperation of automatically calibrating all light sensor modules. Thisauto-calibration operation will hereinafter be described in detail.

This auto-calibration operation is shown in Korean Patent Laid-openPublication No. 10-2012-0045665 (hereinafter referred to as a referencedocument), filed on Oct. 29, 2010 by the same applicant (LG Display Co.,Ltd). According to an automatic angle setting method of an infraredsensor module (light sensor module) disclosed in this referencedocument, an optimum effective viewing angle area is reset with respectto each infrared sensor module based on a reference point, a start pointand an end point. An infrared sensor module and an auto-calibrationalgorithm thereof disclosed in this reference document may be applied tothe present invention. Refer to the above reference document withrespect to a detailed description of the infrared sensor module and theauto-calibration algorithm thereof.

Here, the auto-calibration operation applied to the present inventionmay be performed ahead of the above-stated data generation operation ofthe data generation unit DGN. In detail, the auto-calibration operationmay be performed immediately after the touch display device is poweredon. Then, after this auto-calibration operation is completed, referencedata RF_d and comparison data CM_d may be generated from the datageneration unit DGN based on light sense data from light sensor modulessubjected to auto-calibration.

Alternatively, the auto-calibration operation applied to the presentinvention may be performed in a period between the reference data RF_dgeneration operation of the data generation unit DGN and the comparisondata CM_d generation operation thereof. In other words, theauto-calibration operation may be started after reference data RF_d isgenerated. Then, after this auto-calibration operation is completed, thecomparison data CM_d generation operation may be performed.

On the other hand, the malfunction determination unit MDS in FIG. 3 mayhave, instead of the configuration shown in FIG. 6, a configuration aswill hereinafter be described in detail with reference to FIG. 11.

FIG. 11 is a detailed block diagram showing another configuration of themalfunction determination unit MDS in FIG. 3.

The malfunction determination unit MDS includes, as shown in FIG. 11,first to third comparators CMP1 to CMP3, first to third counters COT1 toCOT3, and first to third determiners DSC1 to DSC3. That is, in theconfiguration of FIG. 11, each of the number of the comparators CMP1 toCMP3, the number of the counters COT1 to COT3 and the number of thedeterminers DSC1 to DSC3 is the same as the number of the light sensormodules.

The first comparator CMP1 compares the first comparison unit averagedata C_AV_d1 and first reference unit average data R_AV_d1 from the datageneration unit with each other and compares the comparison totalaverage data C_TT_d and reference total average data R_TT_d from thedata generation unit DGN with each other.

The second comparator CMP2 compares the second comparison unit averagedata C_AV_d2 and second reference unit average data R_AV_d2 from thedata generation unit DGN with each other and compares the comparisontotal average data C_TT_d and reference total average data R_TT_d fromthe data generation unit DGN with each other.

The third comparator CMP3 compares the third comparison unit averagedata CAV_d3 and third reference unit average data R_AV_d3 from the datageneration DGN with each other and compares the comparison total averagedata C_TT_d and reference total average data R_TT_d from the datageneration unit DGN with each other.

The operation of each of the first to third comparators CMP1 to CMP3 issubstantially the same as that of the comparator CMP in FIG. 6.

The first counter COT1 increases a first check frame value or resets thefirst check frame value to an initial value, based on the comparisonresults from the first comparator CMP1.

The second counter COT2 increases a second check frame value or resetsthe second check frame value to the initial value, based on thecomparison results from the second comparator CMP2.

The third counter COT3 increases a third check frame value or resets thethird check frame value to the initial value, based on the comparisonresults from the third comparator CMP3.

That is, the operation of each of the first to third counters COT1 toCOT3 is substantially the same as that of the counter COT in FIG. 6. Forexample, an rth counter (where r is any one of 1 to 3) adjusts an rthcheck frame value based on comparison results from an rth comparator.Namely, based on the comparison results, the rth counter increments therth check frame value by one or resets the rth check frame value to theinitial value (for example, 0).

The operations of the rth comparator and rth counter will hereinafter bedescribed in detail with reference to the following example.

For example, when the comparison results from the rth comparator satisfya condition that rth comparison unit average data is greater or less by10% than rth reference unit average data and the comparison totalaverage data C_TT_d is greater or less by 10% than the reference totalaverage data R_TT_d, the rth counter increments the rth check framevalue by one. In detail, when the comparison results from the firstcomparator CMP1 satisfy a condition that the first comparison unitaverage data C_AV_d1 is greater or less by 10% than the first referenceunit average data R_AV_d1 and the comparison total average data C_TT_dis greater or less by 10% than the reference total average data R_TT_d,the first counter COT1 increments the first check frame value in thecorresponding frame by one. Conversely, when this condition is notsatisfied, the first counter COT1 resets the first check frame value tothe initial value 0. The operation of each of the remaining second andthird counters COT2 and COT3 is also the same as that of the firstcounter COT1.

The first determiner DSC1 compares the first check frame value from thefirst counter COT1 with a first predetermined threshold value anddetermines whether the first light sensor module IrSM_1 malfunctions,based on a result of the comparison.

The second determiner DSC2 compares the second check frame value fromthe second counter COT2 with a second predetermined threshold value anddetermines whether the second light sensor module IrSM_2 malfunctions,based on a result of the comparison.

The third determiner DSC3 compares the third check frame value from thethird counter COT3 with a third predetermined threshold value anddetermines whether the third light sensor module IrSM_3 malfunctions,based on a result of the comparison.

That is, an rth determiner compares the rth check frame value from therth counter with an rth predetermined threshold value and determineswhether an rth light sensor module malfunctions, based on a result ofthe comparison. In other words, based on the comparison result, the rthdeterminer determines that the rth light sensor module malfunctions orthe rth light sensor module is normal.

For example, when the rth check frame value is equal to the rththreshold value, the rth determiner finally determines that the rthlight sensor module malfunctions. That is, at the moment that the rthcheck frame value reaches the rth threshold value while beingincremented by one in every frame, the rth determiner determines thatthe rth light sensor module malfunctions. In other words, when the abovecondition is successively satisfied in frames of a number correspondingto the rth threshold value, the rth determiner finally determines thatthe rth light sensor module malfunctions.

In contrast, when the rth check frame value is less than the rththreshold value, the rth determiner determines that the rth light sensormodule is normal. Here, the rth threshold value may be, for example, 50.In conclusion, in the case where the rth check frame value issuccessively increased in several frames (for example, 50 frames)(namely, in the case where malfunction is successively detected in theseveral frames), the rth determiner finally determines that the rthlight sensor module malfunctions. The reason is that an abnormal signaldiscontinuously generated in less than 50 frames may be considered to beignorable noise, not an abnormal signal such as static electricity.

When the rth determiner finally determines the rth light sensor moduleto malfunction, in this manner, the above-stated restart control unitRSC of FIG. 3 restarts the rth light sensor module. In this case, thefirst to third light sensor modules IrSM_1 to IrSM_3 may be selectivelyrestarted according to whether they malfunction. For example, in thecase where only malfunction of the first light sensor module IrSM_1 isdetected and the remaining second and third light sensor modules IrSM_2and IrSM_3 are normal, only the first light sensor module IrSM_1 isselectively restarted and the remaining second and third light sensormodules IrSM_2 and IrSM_3, which are normal, are maintained inoperation.

On the other hand, when at least one of the three light sensor modulesIrSM_1 to IrSM_3 is finally determined to malfunction by at least one ofthe first to third determiners DSC1 to DSC3 and then restarted by therestart control unit RSC, the reference data generator RDG generatesreference data RF_d based on light sense data of pth to qth frames(where p is a natural number greater than n and q is a natural numbergreater than p) provided from each of the three light sensor modulesIrSM_1 to IrSM_3. Namely, when at least one of the light sensor modulesIrSM_1 to IrSM_3 malfunctions, it is restarted. In this case, it isrequired to generate new reference data RF_d based on other light sensedata (light sense data corresponding to initial frames) generated fromall the light sensor modules including the restarted light sensormodule. For this reason, after the above restarting, the reference datagenerator RDG generates new reference data RF_d based on the light sensedata of the pth to qth frames (for example, other initial ten frames).At this time, because a check frame value corresponding to the at leastone light sensor module has also already reached a correspondingthreshold value, it is reset to the initial value 0.

On the other hand, when the first to third determiners DSC1 to DSC3determine that the first to third light sensor modules IrSM_1 to IrSM_3are all normal, the comparison data generator CDG generates threecomparison unit average data and one comparison total average data basedon light sense data of a (k+1)th frame (for example, a twelfth frame)provided from each of the first to third light sensor modules IrSM_1 toIrSM_3. Namely, in the case where it is determined that all the lightsensor modules are normal in the current frame (the eleventh frame),based on the analysis results of the light sense data of that frame,light sense data corresponding to a next frame are analyzed in the abovemanner for a determination as to whether the light sensor modulesmalfunction in the next frame. At this time, each check frame value isalso reset to the initial value 0.

The mth to nth frames (or the pth to qth frames) correspond toconsecutive frames immediately after power is applied to the touchdisplay device or immediately after at least one light sensor module isrestarted. In the above example, the mth to nth frames correspond toconsecutive frames immediately after power is applied to the touchdisplay device, and the pth to qth frames correspond to consecutiveframes immediately after at least one light sensor module is restarted.

FIG. 12 is a detailed block diagram showing a configuration of therestart control unit RSC which is controlled based on determinationresults from the first to third determiners DSC1 to DSC3 in FIG. 11.

The restart control unit RSC includes first to third restart controllersRSC1 to RSC3, as shown in FIG. 12.

The first restart controller RSC1 determines whether to restart thefirst light sensor module IrSM_1, based on the determination result fromthe first determiner DSC1.

The second restart controller RSC2 determines whether to restart thesecond light sensor module IrSM_2, based on the determination resultfrom the second determiner DSC2.

The third restart controller RSC3 determines whether to restart thethird light sensor module IrSM_3, based on the determination result fromthe third determiner DSC3.

In this manner, an rth restart controller determines whether to restartthe rth light sensor module, based on the determination result from therth determiner. Therefore, it is possible to individually controlwhether to restart the respective light sensor modules.

FIG. 13 is a detailed block diagram showing a configuration in whichfirst to third switches SW1 to SW3 are included in the configuration ofFIG. 12.

As shown in FIG. 13, an rth switch may further be provided between therth restart controller and the rth light sensor module in FIG. 12. Indetail, the first switch SW1 may further be provided between the firstrestart controller RSC1 and the first light sensor module IrSM_1, thesecond switch SW2 may further be provided between the second restartcontroller RSC2 and the second light sensor module IrSM_2, and the thirdswitch SW3 may further be provided between the third restart controllerRSC3 and the third light sensor module IrSM_3.

Here, the first to third switches SW1 to SW3 in FIG. 13 are the same inconfiguration as the above-stated switch of FIG. 8.

The first switch SW1 supplies the restart signal or the sensor drivingvoltage to the first light sensor module IrSM_1 according to logic of afirst restart determination signal from the first restart controllerRSC1, the second switch SW2 supplies the restart signal or the sensordriving voltage to the second light sensor module IrSM_2 according tologic of a second restart determination signal from the second restartcontroller RSC2, and the third switch SW3 supplies the restart signal orthe sensor driving voltage to the third light sensor module IrSM_3according to logic of a third restart determination signal from thethird restart controller RSC3. Here, because the respective restartcontrollers RSC1 to RSC3 are independently driven, the first to thirdrestart determination signals may have different logic values. As aresult, the operations of the first to third light sensor modules IrSM_1to IrSM_3 are independently controlled.

In the case where the respective light sensor modules are independentlycontrollable in this manner, the touch controller TCC may furtherperform the following operation. For example, when only the first lightsensor module IrSM_1 among the three light sensor modules IrSM_1 toIrSM_3 is restarted and the remaining second and third light sensormodules IrSM_2 and IrSM_3 are normally driven, the touch controller TCCmay determine presence/absence of a touch and generate touchcoordinates, using only light sense data from the second and third lightsensor modules IrSM_2 and IrSM_3. That is, even in a period in which thefirst light sensor module IrSM_1 is restarted, the touch controller TCCmay accurately determine presence/absence of a touch and accuratelygenerate touch coordinates, using the remaining two normal light sensormodules.

FIG. 14 is a flowchart illustrating a light sensor module recoverymethod of a touch display device according to a first embodiment of thepresent invention.

The light sensor module recovery method of the touch display deviceaccording to the first embodiment of the present invention includes analgorithm for recovering the first to third light sensor modules IrSM_1to IrSM_3 shown in FIG. 1.

This light sensor module recovery method according to the firstembodiment roughly includes a data generation step D-s, a malfunctiondetermination step M-s, and a restart control step R-s.

At the data generation step D-s, reference data RF_d and comparison dataCM_d are generated. Also, at this data generation step D-s, adetermination as to whether to generate the comparison data CM_d is madeaccording to whether an auto-calibration operation is performed. Thisdata generation step D-s will hereinafter be described in detail.

First, at step S1, light sense data LS_mn_d1 to LS_mn_d3 of mth to nthframes provided from the three light sensor modules IrSM_1 to IrSM_3 areaccumulated to generate accumulated data AC_d1 to AC_d3.

In detail, at step S1, the light sense data LS_mn_d1 of the mth to nthframes provided from the first light sensor module IrSM_1 areaccumulated to generate the accumulated data AC_d1 of the first lightsensor module IrSM_1. Also, at step S1, the light sense data LS_mn_d2 ofthe mth to nth frames provided from the second light sensor moduleIrSM_2 are accumulated to generate the accumulated data AC_d2 of thesecond light sensor module IrSM_2. Also, at step S1, the light sensedata LS_mn_d3 of the mth to nth frames provided from the third lightsensor module IrSM_3 are accumulated to generate the accumulated dataAC_d3 of the third light sensor module IrSM_3. The accumulated dataAC_d1 to AC_d3 generated at step S1 are the same as those generated bythe above-stated accumulated data generator ADG, and a detaileddescription of step S1 will thus be omitted.

Thereafter, at step S2, reference data RF_d is generated based on thelight sense data LS_mn_d1 to LS_mn_d3 of mth to nth frames provided fromthe three light sensor modules IrSM_1 to IrSM_3. This reference dataRF_d includes three reference unit average data R_AV_d1 to R_AV_d3 andone reference total average data R_TT_d, which are generated at step S2in the following manner.

That is, at step S2, the accumulated data AC_d1 of the first lightsensor module IrSM_1 is divided by the number (for example, 500) ofpixels formed in the first light sensor module IrSM_1 to generate thereference unit average data R_AV_d1 of the first light sensor moduleIrSM_1. Also, at step S2, the accumulated data AC_d2 of the second lightsensor module IrSM_2 is divided by the number of pixels formed in thesecond light sensor module IrSM_2 to generate the reference unit averagedata R_AV_d2 of the second light sensor module IrSM_2. In a similarmanner, at step S2, the accumulated data AC_d3 of the third light sensormodule IrSM_3 is divided by the number of pixels formed in the thirdlight sensor module IrSM_3 to generate the reference unit average dataR_AV_d3 of the third light sensor module IrSM_3. In addition, at stepS2, a sum of the three reference unit average data R_AV_d1 to R_AV_d3 isdivided by 3 (the number of the light sensor modules) to generate thereference total average data R_TT_d. The reference unit average dataR_AV_d1 to R_AV_d3 and the reference total average data R_TT_d generatedat step S2 are the same as those generated by the above-stated referencedata generator RDG, and a detailed description of step S2 will thus beomitted.

Next, at step S3, a determination is made as to whether theauto-calibration operation has been performed. If it is determined atstep S3 that the auto-calibration operation has not been performed yet,the above steps S1 and S2 are sequentially performed again. Namely,whenever steps S1 and S2 are performed, accumulated data and referencedata RF_d are generated with respect to light sense data of the currentframe. As a result, steps S1 and S2 are sequentially repeated until theauto-calibration operation at step S3 is completed. Because theauto-calibration operation at step S3 is completed when a period of themth to nth frames has elapsed, accumulated data and reference data RF_dare generated with respect to the light sense data of the mth to nthframes as stated above at a time that the auto-calibration operation atstep S3 is completed.

This auto-calibration operation is the same as that performed by theabove-stated touch controller TCC, and a description thereof will thusbe omitted.

On the other hand, at step S3, performing the auto-calibration operationmay be replaced with determining whether the current frame correspondsto one of the mth to nth frames.

After the above step S3 is performed, step S4 is performed.

At step S4, comparison data CM_d is generated based on light sense dataLS_k_d1 to LS_k_d3 of a kth frame (where k is a natural number greaterthan n) provided from the three light sensor modules IrSM_1 to IrSM_3.This comparison data CM_d includes three comparison unit average dataC_AV_d1 to C_AV_d3 and one comparison total average data C_TT_d, whichare generated at step S4 in the following manner.

That is, at step S4, the light sense data LS_k_d1 of the kth frame (forexample, an eleventh frame) provided from the first light sensor moduleIrSM_1 are summed up to generate sum data, and the sum data is dividedby the number (for example, 500) of pixels formed in the first lightsensor module IrSM_1 to generate the comparison unit average dataC_AV_d1 of the first light sensor module IrSM_1. Also, at step S4, thelight sense data LS_k_d2 of the kth frame (for example, the eleventhframe) provided from the second light sensor module IrSM_2 are summed upto generate sum data, and the sum data is divided by the number (forexample, 500) of pixels formed in the second light sensor module IrSM_2to generate the comparison unit average data C_AV_d2 of the second lightsensor module IrSM_2. In a similar manner, at step S4, the light sensedata LS_k_d3 of the kth frame (for example, the eleventh frame) providedfrom the third light sensor module IrSM_3 are summed up to generate sumdata, and the sum data is divided by the number (for example, 500) ofpixels formed in the third light sensor module IrSM_3 to generate thecomparison unit average data C_AV_d3 of the third light sensor moduleIrSM_3. In addition, at step S4, a sum of the three comparison unitaverage data C_AV_d1 to C_AV_d3 is divided by 3 (the number of the lightsensor modules) to generate the comparison total average data C_TT_d.

At the malfunction determination step M-s, a determination as to whetherthe light sensor modules malfunction is made based on a comparisonbetween the generated reference data RF_d and the generated comparisondata CM_d. At this malfunction determination step M-s, the determinationas to whether the light sensor modules malfunction is made in everyframe. Only when malfunction is successively detected from a certainlight sensor module in frames of a number corresponding to apredetermined threshold value (for example, 50), the light sensor moduleis finally determined to malfunction. This malfunction determinationstep M-s will hereinafter be described in detail.

First, at step S5, a determination is made as to whether at least one ofthe three light sensor modules IrSM_1 to IrSM_3 malfunctions. To thisend, at step S5, a determination is made as to whether the firstcomparison unit average data C_AV_d1 is greater or less by 10% than thefirst reference unit average data R_AV_d1, the second comparison unitaverage data C_AV_d2 is greater or less by 10% than the second referenceunit average data R_AV_d2, the third comparison unit average dataC_AV_d3 is greater or less by 10% than the third reference unit averagedata R_AV_d3 and the comparison total average data C_TT_d is greater orless by 10% than the reference total average data R_TT_d. When theresult of this determination is true, the at least one light sensormodule is determined at step S5 to malfunction.

When the determination result of step S5 is YES, step S6-1 is performed.At step S6-1, a check frame value is incremented by one.

In contrast, when the determination result of step S5 is NO, step S6-2is performed. At step S6-2, the check frame value is reset to an initialvalue 0.

Then, at step S7, a determination is made as to whether the check framevalue is equal to the predetermined threshold value 50. When thedetermination result of step S7 is NO, steps S4 to S7 are againperformed. Namely, steps S4 to S7 are repeated as malfunction issuccessively detected in frames of a number corresponding to thethreshold value. Ultimately, these steps S4 to S7 are repeated until thecheck frame value becomes equal to the threshold value. When the checkframe value becomes equal to the threshold value, step S8 is performed.

Step S8 is the restart control step R-s. At step S8, the at least onelight sensor module is restarted. Alternatively, at step S8, all thelight sensor modules may be restarted.

The above steps S5 to S8 are the same as the operations performed by theabove-stated comparator CMP, counter COT, determiner DSC and restartcontrol unit RSC, and a detailed description thereof will thus beomitted.

FIGS. 15A and 15B are flowcharts illustrating a light sensor modulerecovery method of a touch display device according to a secondembodiment of the present invention.

The light sensor module recovery method of the touch display deviceaccording to the second embodiment of the present invention includes analgorithm for recovering the first to third light sensor modules IrSM_1to IrSM_3 shown in FIG. 1.

This light sensor module recovery method according to the secondembodiment roughly includes a data generation step D-s, a firstmalfunction determination step M1-s, a second malfunction determinationstep M2-s, a third malfunction determination step M3-s, a first restartcontrol step R1-s, a second restart control step R2-s, and a thirdrestart control step R3-s.

Here, steps S11, S22, S33 and S44 of the data generation step D-s in thesecond embodiment are the same as the above steps S1, S2, S3 and S4 ofthe data generation step D-s in the first embodiment, and a descriptionthereof will thus be omitted.

At the first malfunction determination step M1-s, a determination as towhether the first light sensor module IrSM_1 malfunctions is made basedon a comparison between the generated first reference unit average dataR_AV_d1 and first comparison unit average data CAV_d1 and a comparisonbetween the generated reference total average data R_TT_d and comparisontotal average data C_TT_d. At this first malfunction determination stepM1-s, the determination as to whether the first light sensor moduleIrSM_1 malfunctions is made in every frame. Only when malfunction issuccessively detected from the first light sensor module IrSM_1 inframes of a number corresponding to a predetermined threshold value (forexample, 50), the first light sensor module IrSM_1 is finally determinedto malfunction. This first malfunction determination step M1-s willhereinafter be described in detail.

First, at step S55, a determination is made as to whether the firstlight sensor module IrSM_1 malfunctions. To this end, at step S55, adetermination is made as to whether the first comparison unit averagedata C_AV_d1 is greater or less by 10% than the first reference unitaverage data R_AV_d1 and the comparison total average data C_TT_d isgreater or less by 10% than the reference total average data R_TT_d.When the result of this determination is true, the first light sensormodule IrSM_1 is determined at step S55 to malfunction.

When the determination result of step S55 is YES, step S66-1 isperformed. At step S66-1, a first check frame value is incremented byone.

In contrast, when the determination result of step S55 is no, step S66-2is performed. At step S66-2, the first check frame value is reset to aninitial value 0.

Then, at step S77, a determination is made as to whether the first checkframe value is equal to a first predetermined threshold value 50. Whenthe determination result of step S77 is NO, steps S44 to S77 are againperformed. Namely, steps S44 to S77 are repeated as malfunction issuccessively detected in frames of a number corresponding to the firstthreshold value. Ultimately, these steps S44 to S77 are repeated untilthe first check frame value becomes equal to the first threshold value.When the first check frame value becomes equal to the first thresholdvalue, step S88 is performed.

Step S88 is the first restart control step R1-s. At step S88, the firstlight sensor module IrSM_1 is restarted.

Steps S55, S66-1, S66-2, S77 and S88 of the first malfunctiondetermination step M1-s and first restart control step R1-s are the sameas the operations performed by the above-stated first comparator CMP1,first counter COT1, first determiner DSC1 and first restart controllerRSC1, and a detailed description thereof will thus be omitted.

Similarly, steps S55, S66-1, S66-2, S77 and S88 of the secondmalfunction determination step M2-s and second restart control step R2-sare the same as the operations performed by the above-stated secondcomparator CMP2, second counter COT2, second determiner DSC2 and secondrestart controller RSC2, and a description thereof will thus be omitted.

Similarly, steps S55, S66-1, S66-2, S77 and S88 of the third malfunctiondetermination step M3-s and third restart control step R3-s are the sameas the operations performed by the above-stated third comparator CMP3,third counter COT3, third determiner DSC3 and third restart controllerRSC3, and a description thereof will thus be omitted.

FIG. 16 is a flowchart illustrating a light sensor module recoverymethod of a touch display device according to a third embodiment of thepresent invention.

The light sensor module recovery method of the touch display deviceaccording to the third embodiment of the present invention includes analgorithm for recovering the first to third light sensor modules IrSM_1to IrSM_3 shown in FIG. 1.

This light sensor module recovery method according to the thirdembodiment roughly includes a data generation step D-s, a malfunctiondetermination step M-s, and a restart control step R-s.

Here, steps S555, S666-1, S666-2 and S777 of the malfunctiondetermination step M-s in the third embodiment are the same as the abovesteps S5, S6-1, S6-2 and S7 of the malfunction determination step M-s inthe first embodiment, and a description thereof will thus be omitted.

According to the third embodiment of the present invention, theauto-calibration operation is first performed, and the data accumulationstep, the reference data RF_d generation step and the comparison dataCM_d generation step are then performed after the auto-calibrationoperation is completed. Each step is the same as that in the firstembodiment.

In the third embodiment, the auto-calibration operation is completedwithin a period corresponding to the mth to nth frames, and accumulateddata and reference data RF_d are then generated with respect to severalframes subsequent to the nth frame at steps S222 and S333.

On the other hand, although not shown, the data generation step D-s inFIG. 15A may be replaced with the above-stated data generation step D-sin FIG. 16.

FIG. 17 illustrates equations of accumulated data, reference unitaverage data and reference total average data in the present invention.

In FIG. 17, a parameter SUM_cam1 signifies first accumulated data of thefirst light sensor module IrSM_1, which is expressed by a sum of lightsense data sum_cam1 of a current frame and accumulated light sense dataMCU_DMA of previous frames.

Similarly, a parameter SUM_cam2 signifies second accumulated data of thesecond light sensor module IrSM_2, which is expressed by a sum of lightsense data sum_cam2 of a current frame and accumulated light sense dataMCU_DMA of previous frames.

Similarly, a parameter SUM_cam3 signifies third accumulated data of thethird light sensor module IrSM_3, which is expressed by a sum of lightsense data sum_cam3 of a current frame and accumulated light sense dataMCU_DMA of previous frames.

A parameter ave_cam1 signifies first reference unit average data of thefirst light sensor module IrSM_1, which is expressed by a division ofthe first accumulated data by the number 500 of pixels in the firstlight sensor module IrSM_1.

Similarly, a parameter ave_cam2 signifies second reference unit averagedata of the second light sensor module IrSM_2, which is expressed by adivision of the second accumulated data by the number 500 of pixels inthe second light sensor module IrSM_2.

Similarly, a parameter ave_cam3 signifies third reference unit averagedata of the third light sensor module IrSM_3, which is expressed by adivision of the third accumulated data by the number 500 of pixels inthe third light sensor module IrSM_3.

A parameter total cam signifies reference total average data, which isexpressed by a division of a sum of the first to third reference unitaverage data by the number 3 of the light sensor modules.

FIG. 18 illustrates, in the form of equations, the step of determiningwhether the light sensor modules malfunction.

In FIG. 18, a parameter each_cam_block_compare_check represents theresult of a comparison between comparison data CM_d and reference dataRF_d collected from each light sensor module. If this comparison resultsatisfies the above-stated condition (the condition proposed in thecomparator CMP) (True), a parameter ESD_check_flag is activated (On).Here, the parameter ESD_checkflag signifies whether malfunction isdetected, and is activated (On) if the above condition is satisfied(True).

If the parameter ESD_check_flag is activated, a parameterContinue_repeat_check, which signifies a check frame value, isincremented by one.

If the parameter Continue_repeat_check reaches a threshold value 50, aparameter ESD RECOVER, which signifies restart, is activated (ON) torestart a corresponding light sensor module.

FIG. 19 is a waveform diagram of reference signals which are generatedbased on light sense data of an initial frame generated from each of thefirst to third light sensor modules IrSM_1 to IrSM_3.

In FIG. 19, a first reference signal G1 includes light sense data (500light sense data) of one frame (an initial one frame) generated from thefirst light sensor module IrSM_1, a second reference signal G2 includeslight sense data (500 light sense data) of one frame (an initial oneframe) generated from the second light sensor module IrSM_2, and a thirdreference signal G3 includes light sense data (500 light sense data) ofone frame (an initial one frame) generated from the third light sensormodule IrSM_3.

Because the respective light sensor modules are different ininstallation position, light sense data collected for a period of theinitial one frame may have somewhat different values by referencesignals.

FIG. 20 is a waveform diagram illustrating variations in referencesignals resulting from the influence of static electricity.

In FIGS. 20(a), 20(b) and 20(c), a first reference signal G1 includeslight sense data generated from the first light sensor module IrSM_1, asecond reference signal G2 includes light sense data generated from thesecond light sensor module IrSM_2, and a third reference signal G3includes light sense data generated from the third light sensor moduleIrSM_3.

In the case where static electricity is introduced to all of the firstto third light sensor modules IrSM_1 to IrSM_3, all of the light sensedata included in the first to third reference signals G1 to G3 maysomewhat fall in value, as shown in FIG. 20(a). As the staticelectricity becomes stronger, variation of the values increases.

On the other hand, in the case where static electricity is introduced toall of the first to third light sensor modules IrSM_1 to IrSM_3, all ofthe light sense data included in the first to third reference signals G1to G3 may somewhat rise in value, as shown in FIG. 20(b). As the staticelectricity becomes stronger, variation of the values increases.

On the other hand, in the case where static electricity is introduced toall of the first to third light sensor modules IrSM_1 to IrSM_3, thelight sense data included in the first to third reference signals G1 toG3 may partially significantly rise in value and partially fall invalue, as shown in FIG. 20(c).

In the present invention, even if a reference signal is distorted due tostatic electricity as shown in FIG. 20, this reference signal can becorrected to its normal state as shown in FIG. 19 by restarting acorresponding light sensor module.

As is apparent from the above description, a touch display device and alight sensor module recovery method thereof according to the presentinvention have effects as follows.

A malfunctioning one of light sensor modules is found out by monitoringthe operating states of the light sensor modules in real time. Then, themalfunctioning light sensor module is restarted such that it normallyoperates. Therefore, according to the present invention, even if anexternal abnormal signal such as static electricity is introduced to thelight sensor modules, it is possible to accurately calculate touchcoordinates.

It will be apparent to those skilled in the art that variousmodifications and variations can be made in the present inventionwithout departing from the spirit or scope of the inventions. Thus, itis intended that the present invention covers the modifications andvariations of this invention provided they come within the scope of theappended claims and their equivalents.

What is claimed is:
 1. A touch display device comprising: i light sensor modules including a light emitting diode and a photosensor, where the i light sensor modules sense a touch applied to a touch display panel, and i is a natural number greater than 1; and a malfunction recovery unit coupled to the i light sensor modules, wherein the malfunction recovery unit determines whether each of the i light sensor modules malfunctions and restarts at least one of the i light sensor modules when the at least one light sensor module is determined to malfunction, wherein the malfunction recovery unit comprises: a data generation unit that generates reference data based on light sense data of mth to nth frames provided from each of the i light sensor modules and generates comparison data based on light sense data of a kth frame provided from the each of the i light sensor modules, k being a natural number greater than n, a malfunction determination unit that compares the comparison data from the data generation unit with the reference data therefrom and determines whether the i light sensor modules malfunction, based on a result of the comparison, and a restart control unit that determines whether to restart the at least one of the i light sensor modules, based on a result of the determination of the malfunction determination unit, wherein the data generation unit comprises: an accumulated data generator that accumulates the light sense data of the mth to nth frames provided from the each of the i light sensor modules to generate i accumulated data of the i light sensor modules, a reference data generator that divides each of the i accumulated data by the number of pixels formed in the corresponding light sensor module to generate i reference unit average data, and divides a sum of the i reference unit average data by i to generate reference total average data, and a comparison data generator that sums up the light sense data of the kth frame provided from the each of the i light sensor modules to generate i sum data of the i light sensor modules, divides each of the i sum data by the number of the pixels formed in the corresponding light sensor module to generate i comparison unit average data of the i light sensor modules, and divides a sum of the i comparison unit average data by i to generate comparison total average data, wherein the i reference unit average data and the reference total average data are included in the reference data, and wherein the i comparison unit average data and the comparison total average data are included in the comparison data.
 2. The touch display device according to claim 1, wherein the malfunction recovery unit determines whether each of the i light sensor modules malfunctions, based on whether static electricity is introduced to a corresponding one of the i light sensor modules.
 3. The touch display device according to claim 1, wherein the malfunction determination unit comprises: a comparator that compares each of the i comparison unit average data from the data generation unit with a corresponding one of the i reference unit average data from the data generation unit and compares the comparison total average data with the reference total average data; a counter that increases a check frame value or resetting the check frame value to an initial value, based on comparison results from the comparator; and a determiner that compares the check frame value from the counter with a predetermined threshold value and determines that the at least one of the i light sensor modules malfunctions or the i light sensor modules are normal, based on a result of the comparison, wherein the reference data generator generates reference data based on light sense data of pth to qth frames provided from each of the i light sensor modules when the determiner determines that the at least one light sensor module malfunctions, p being a natural number greater than n and q being a natural number greater than p, and wherein the comparison data generator generates i comparison unit average data and comparison total average data based on light sense data of a (k+1)th frame provided from each of the i light sensor modules when the determiner determines that the i light sensor modules are normal.
 4. The touch display device according to claim 3, wherein the determiner determines that the at least one of the i light sensor modules malfunctions, when the check frame value is equal to the threshold value, and determines that the i light sensor modules are normal, when the check frame value is less than the threshold value.
 5. The touch display device according to claim 4, wherein the determiner resets the check frame value to the initial value when the check frame value is equal to the threshold value.
 6. The touch display device according to claim 5, wherein the counter increments the check frame value by one when the comparison results from the comparator satisfy a condition that each of the i comparison unit average data is greater or less by 10% than the corresponding one of the i reference unit average data and the comparison total average data is greater or less by 10% than the reference total average data, and resets the check frame value to the initial value when the comparison results from the comparator do not satisfy the condition.
 7. The touch display device according to claim 3, wherein the restart control unit restarts the at least one of the i light sensor modules when the determiner determines that the at least one light sensor module malfunctions.
 8. The touch display device according to claim 5, wherein the restart control unit restarts all of the i light sensor modules when the determiner determines that the at least one of the i light sensor modules malfunctions.
 9. The touch display device according to claim 1, wherein the mth to nth frames are generated immediately after power is applied to the touch display device or immediately after the at least one of the i light sensor modules is restarted.
 10. The touch display device according to claim 1, wherein the malfunction recovery unit further comprises i switches each of which selects any one of a restart signal and a sensor driving voltage based on the determination of the restart control unit and transmits the selected one to a corresponding one of the i light sensor modules.
 11. The touch display device according to claim 10, wherein the restart signal comprises an initialization voltage and the sensor driving voltage, the initialization voltage and the sensor driving voltage being sequentially generated, wherein the initialization voltage is generated ahead of the sensor driving voltage.
 12. The touch display device according to claim 1, further comprising a touch controller that calculates coordinates of the touch based on the light sense data provided from the i light sensor modules, wherein the light sense data provided from the i light sensor modules are stored in a memory of the touch controller, and wherein the light sense data stored in the memory are read by the data generation unit and the touch controller.
 13. The touch display device according to claim 12, wherein the touch controller temporarily stops a touch presence/absence determination operation and a touch coordinates calculation operation for a predetermined period of time when the at least one light sensor module is restarted.
 14. The touch display device according to claim 13, wherein the predetermined period of time is 2 seconds or less.
 15. The touch display device according to claim 1, further comprising a touch controller that calculates coordinates of the touch based on the light sense data provided from the i light sensor modules and performs an auto-calibration operation for the i light sensor modules, wherein the auto-calibration operation of the touch controller is performed ahead of a data generation operation of the data generation unit or in a period between a reference data generation operation and a comparison data generation operation of the data generation unit.
 16. The touch display device according to claim 1, wherein each of the i light sensor modules is an infrared sensor module, the infrared sensor module sensing the touch using an infrared ray.
 17. The touch display device according to claim 1, wherein the malfunction determination unit comprises: first to ith comparators each of which compares a corresponding one of the i comparison unit average data from the data generation unit with a corresponding one of the i reference unit average data from the data generation unit and compares the comparison total average data with the reference total average data; first to ith counters each of which increases a corresponding check frame value or resets the corresponding check frame value to an initial value, based on comparison results from a corresponding one of the first to ith comparators; and first to ith determiners each of which compares the check frame value from a corresponding one of the first to ith counters with a predetermined threshold value and determines whether a corresponding one of the i light sensor modules malfunctions, based on a result of the comparison, wherein the reference data generator generates reference data based on light sense data of pth to qth frames provided from each of the i light sensor modules when any one of the determiners determines that the corresponding light sensor module malfunctions, p being a natural number greater than n and q being a natural number greater than p, and wherein the comparison data generator generates i comparison unit average data and comparison total average data based on light sense data of a (k+1)th frame provided from each of the i light sensor modules when the determiners determine that the i light sensor modules are normal.
 18. The touch display device according to claim 17, wherein an rth one of the counters, where r is any one of 1 to i, increments the corresponding check frame value by one when the comparison results from an rth one of the comparators satisfy a condition that the comparison unit average data of an rth one of the light sensor modules is greater or less by 10% than the reference unit average data of the rth light sensor module and the comparison total average data is greater or less by 10% than the reference total average data, and resets the corresponding check frame value to the initial value when the comparison results from the rth comparator do not satisfy the condition.
 19. The touch display device according to claim 18, wherein the restart control unit comprises first to ith restart controllers each of which determines whether to restart the corresponding light sensor module, based on a determination result from a corresponding one of the first to ith determiners.
 20. The touch display device according to claim 19, wherein an rth one of the restart controllers, where r is any one of 1 to i, restarts the rth light sensor module when an rth one of the determiners determines that the rth light sensor module malfunctions.
 21. The touch display device according to claim 20, further comprising a touch controller that calculates coordinates of the touch based on the light sense data provided from the i light sensor modules, wherein the touch controller, when any one of the i light sensor modules is restarted and the remaining two or more light sensor modules are normally driven, calculates the touch coordinates using the light sense data from the remaining two or more light sensor modules.
 22. The touch display device according to claim 20, further comprising a touch controller that calculates coordinates of the touch based on the light sense data provided from the i light sensor modules, wherein the touch controller temporarily stops a touch coordinates calculation operation for a predetermined period of time when at least two of the i light sensor modules are restarted. 